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Abstract. In this paper we study the large deviation behav- 
ior of sums of i.i.d. random variables Xi defined on a supercrit- 
ical Galton- Watson process Z. We assume the finiteness of the 
moments EXf and EZi log Zi . The underlying interplay of the 
partial sums of the Xi and the lower deviation probabilities of Z 
is clarified. Here we heavily use lower deviation probability results 
on Z we recently published in jFW06| . 
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1. Introduction and results 

1.1. Motivation. Let Z = {Zn)n>a denote a Galton- Watson process with off- 
spring law {pk'y k > 0}. We will assume that Z is supercritical: m := X]fe°=i ^Pk G 
(l,oo). As a rule we start with Zq = 1. 

A basic task in statistical inference of Galton- Watson processes is the estimation 
of the offspring mean to. Let us recall at this place the well-known Lotka-Nagaev 
estimator Zn+i/Zn of m due to A.V. Nagaev |Nag67| . If a := (VarZi)^/^ e (0,oo), 
then for every a; € R, 

\imP(m''/^{^-m) <x; Zn>Oj ^ J ^{^^)w{u)du, (1) 

where w denotes the density function of the a.s. limit variable W :— lim„|oo 
restricted to (0, oo), and $ is the standard normal distribution function, 

$(y) := -1= e--'/2dz, yeM. (2) 

The study of the ratio Zn+i/Zn has attracted the attention of several researchers 
in recent years, since it can also be used for estimating important parameters such 
as the amplification rate and the initial size in a quantitative polymerase chain 
reaction experiment; see Jacob and Peccoud [JPyGLUPOSI . 

Fix fc > 0. In a finer description of the Galton- Watson model, let Zn{k) denote 
the number of particles in the n*^ generation having exactly k children. Then, on 
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the event {Zn > 0}, results for the estimator pk{n) '.— Zn{k)/Zn of pk , which 
hold analogously to ^ , had been provided by Pakes |Pak75l Theorems 5 and 6] . 

The mentioned results from "Nag67' and |Pak75| can be seen from a unified 
point of view as follows. Independently of Z, let X = {X„)n>i denote a family 
of i.i.d. random variables with mean zero and variance in (0,oo). Let n > 0. Put 
Sn Xi + . . . + Xn ■ On the event {Z„ > 0}, the random variable 

Rn Sz„/Zn (3) 

is well-defined. For convenience, we agree that an event involving i?„ is always 
tacitly assumed to be included in {Zn > 0}. For instance, P(i?„ < x) means 
P(i?„ < x; Zn > O) more carefully written. If now Xi coincides in law with 
Zi — TO, then, for n fixed, Rn coincides in law with Z„+i/Z„ — m on the event 
{Zn > 0}. On the other hand, if Xi takes on the value 1 — pk with probability 
Pk (for k fixed) and —pk otherwise, then i?„ = Pk{n) — Pk in law on the event 
{Zn > 0} for fixed n . 

Sums such as Sz^ arise also in models of polymerase chain reactions with mu- 
tations, see Piau jPia04j . 

From now on, we work with the more general meaning of i?„ , based on [X, Z), 
as introduced in (PJ. Clearly, we have the following strong law of large numbers: 

Rn ^ a.s. as n t oo. (4) 

Moreover, using methods from |Nag67| and |Pak75| . one can easily verify the fol- 
lowing "norma/ deviation probabilities^^ for i?„ : 

lim P(m"/2i?„ < = / ^(2^)w{u)du, x e R, (5) 

"Too Jq " 

where a :— (EXfY^^ from now on. Let e„ > 0. In the case Snm^^^ — > oo, this 
implies the following simple large deviation probabilities for i?„ ■ 

lim P{Rn > En) = 0. (6) 

nf oo 

But the main task of large deviation theory is to determine the rate of this conver- 
gence. Clearly, one of the reasons to be interested in large deviation probabilities 
comes from statistical applications. Firstly, these probabilities describe the quality 
(error probabilities) of many tests. On the other hand, a question concerning the 
Bahadur efficiency of estimators leads also to the large deviation problem. 

For the particular model Xi = Zi — m, the special case e„ = e is more or less 
studied in the literature. In fact, Athreya |Ath94| proved that if po = 0, pi > 0, 
and EZ^""*"*^ < oo for some S > 0, where a G (0, oo) denotes the so-called Schroder 
constant [see © below], then 

lim m""P(|i?„| > e) exists finitely. (7) 

ntcxD 

On the other hand, using asymptotic properties of harmonic moments of Z„ , Ney 
and Vidyashankar |NV03j found the rate of P(|i?,i| > e) under the weaker assump- 
tion that P(Zi > j) ~ aj^~^ as j { oo, for some rj > 2 and a > 0. The same 
authors proved in |NV04| a version of a large deviation principle for i?„ conditioned 
on Zn > Vn with numbers w„ — > oo; see also Rouault |RouOO| . 

The purpose of the present paper is to study the rate of convergence of large 
deviation probabilities of i?„ > £„ in the more interesting case as n "f oo 
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(working with our more general setting of i?„). For this we heavily relay on results 
on lower deviation probabilities of we recently derived in jFW06| . In the next 
subsection we briefly recall what we need from that paper. 

Note that large deviation probabilities in the case e„ — > are needed, for in- 
stance, for testing two close hypotheses, i.e. when the distance between the hy- 
potheses tends to zero as the size of the sample gets larger and larger. 

1.2. Lower deviation probabilities for Z. We start with recalling the follow- 
ing basic notation, reflecting a crucial dichotomy for supercritical Galton- Watson 
processes. 

Definition 1 (Schroder and Bottcher case). For our supercritical offspring 
distribution we distinguish between the Schroder and the Bottcher case, in depen- 
dence on whether po > or = 0, respectively. O 

Write / for the generating function of our supercritical offspring law: /(s) = 
J2j>oPj^'' ^ < s < 1. Let q denote the extinction probability of Z, 

set 7 f'{q), and define a by 7 = m^". (8) 

Note that 7 € [0, 1) and a £ (0, 00]. Obviously, we are in the Schroder case if and 
only if 7 > 0, if and only if a < 00. In this case, a is said to be the Schroder 
constant. We also need the following notion. 

Definition 2 (Type (c?, /i)). We say the offspring distribution is of type {d,ii), if 
d > I is the greatest common divisor of the set {j — i ■ j PjPi > 0}, and 
fi > is the minimal j for which pj > 0. O 

In the present paper, (d, fi) always refers to the type of our offspring law. Recall 
that in the Bottcher case, fi = min{fc > : pfe > 0} > 2. Here the Bottcher constant 
P G (0, 1) is defined by = m'^ . 

We also always assume that the moment EZi log Zi is finite. Under this moment 
condition, the results of | lFW06| can be specialized to the following two propositions. 

Proposition 3 (Schroder case). In the Schroder case, for kn < m" satisfying 
/c„ — > 00, we have 



sup 

k^[kn,ni^] with k=^(modd) 



sup 

ke[kn,m"] 



d'w{k/m'^^ 

P(0 <Zn<k) 
P(0 <W < k/m'^) 



m 

P(Z„ = fc) - 1 



— > (9) 

n\oc 



1 



0. (10) 

nycxD 



Proposition 4 (Bottcher case). Suppose the Bottcher case. Then there exist 
positive constants Bi and B2 such that for all kn > /x" with k„ = o(m") as 
n "f 00, 

-Bi < liminf (fc„/m")''/(i-'')logP(Z„ < fc„) (11a) 

n"f 00 

< limsup(fc„/m")'5/(i-«logP(Z„ < fc„) < -B2 . (lib) 

The inequalities ()ll|l remain true if P{Zn < fc„) is replaced by m"P(Z„ = fc„), 
provided that kn = /x" (mod d) . 



4 



FLEISCHMANN AND WACHTEL 



In order to explain the influence of lower deviation probabilities of Zn on i?„ = 
Sz„/Zn , we look at the decomposition, 

oc 

P(i?n>£„) = ^P(Z„ = fc)P(5fe >e„fc). (12) 

k=l 

Thus, in order to find the asymptotics of P(i?„ > £n), we need to determine the 
range of values of fc, which give the main contribution in decomposition (|12|l . As we 
will see, this depends on parameters of the offspring law (as a, for instance) and, on 
the other hand, on the tail behavior of Xi . Here we mention several possibilities. If 
k is of order to" (the regime of normal deviations for Zn) and e^to" oo, then e„fc 
is in the domain of large deviations of Sk- On the other hand, if k is of order 
(regime of normal deviations for Sk)^ then k is in the domain of lower deviations 
for Zn ■ And finally, if kjrriP' — > and £\k —> oo, then simultaneously we have lower 
deviations for Zn and large deviations for Sk ■ 

1.3. Large deviations in the Schroder case. Recall that we always assume 
EZi logZi < oo and F,Xf < oo. As usual, we set := Xi V 0. 

Theorem 5 (Schroder under a (1 + a)-moment condition on Xi). Suppose 
the Schroder case and that 

E(X+)i+" < oo (13) 

[with a G (0, oo) the Schroder constant from ©]. Moreover, assume that e„ — > 
and e^jTO" ^ oo as n | oo. Then 

< V;r„ < liminf 4"TO""P(i?„ > e„) (14a) 
< limsup 4"TO""P(i?„ >£„) < V*ro, < oo, (14b) 



where 



K := liminf m'~"w(u), V* := limsup m'~"w(u) (15) 

and 

Of course, here F refers to the Gamma function. 

Next we recall some known facts on the asymptotic behavior of supercritical 
Galton- Watson processes in the Schroder case. With q and 7 introduced in the 
beginning of Subsection 11.21 and with /„ denoting the iterates of /, the following 
limit exists: 

lim -^"^''^ ~ S(s) Y ly.s^ , < s < 1. (17) 

' 3=0 

Hence, 

Iim7-"P(Z„ = fc) = i/fe, k>l. (18) 

n^oc 

The Schroder constant a < 00 describes the behavior of the density function w{u) 
as M J, 0. In fact, according to Biggins and Bingham |BB93j . there is a continuous, 
positive multiplicatively periodic function V such that 

u^-"w{u) ^ V{u) +o{l) asuiO. (19) 
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The function V in 1)19(1 can be replaced by a (positive) constant Vq if and only if 

S{ip{h)) = Voh-°', h>0, (20) 

where ip denotes the Laplace transform of the limit random variable W (cf. As- 
mussen and Hering |AH83I p. 96]. In this case, V* = in Thcorcm|3 and we get 
the following conclusion. 

Corollary 6 (Schroder under an additional regularity of Z). If (I20|l holds, 
then under the assumptions of Theorem |SJ 

lim4"m""P(i?„ >£„) = VoT^ (21) 

nt oo 

[with Fq, from (I16|) ]. 

Under the assumptions of Theorem |S1 the sum at the right hand side of (|12|l is 
determined by those values of k which are of order As we already mentioned, 
this corresponds to lower deviations of Z and normal deviations of Sk ■ But what 
happens if moment condition H13() fails? We are able to answer this question under 
some regularity of the tail probabilities of Xi . For this purpose, we say that Xi 
has a tail of index 9, if for some constant a > 0, 

V{Xi >x)^ ax~^ as x t oo. (22) 

(Here the involved constant is always denoted by a.) 

Theorem 7 (Schroder under heavier tails concerning Xi). Suppose that 1 
< a < oo and that Xi has a tail of index 9 d (2, 1 + a). Define h .= (1 + a — 
9)l{2a-9). 

(a) // e„m^" — s- 0, hut e'^m" — > oo, then statements (114(1 remain valid. 

(b) // e„m^" — > oo, then 

lime^m(''-i)"P(i?„ >e„) alg, (23) 

nf oo 

where 

1 r°° 

Is := .(.).-d.. (24) 

(c) // £„m^" T-^ e (0,oo), then 

T^^V^T^+r'^alg < liminf m"(^-2)"/(2"-«)p(i?„ >e„) (25) 

ntoo 

< limsupm"(''-2)"/(2«-0)p(^^^ > < T^'^v*Tc, + T''aIe 

njoo 

[with V^,V* from (US)) and F^ from ((TB|l ]. 

Large deviations as in part (b) have a structure, different from that in Theo- 
rem |S1 Here the main contribution comes from normal deviations of Zn and large 
deviations of 5„ . In part (c) we have a combination of regimes appearing in (a) 
and (b). 

Remark 8 (Critical value of 9). Theorems |S1 and [7| leave open the case that Xi 
has a tail of index 9 = a + 1. Our methods allow to prove that (under 1 < a < oo) 
part (a) holds, if enn^^^°'^^'' 0. On the other hand, if £„n-'^/*^"~-'^^ oo, then 

lim n-^ £i+" m"" P(i?„ > e„) = a J^, (26) 
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where 

Jo. S{^{v))v"-Uv. (27) 

Finally, if en'n}^^°'^'^^ t^^ G (0,oo), then a similar statement as in (c) is true.O 

1.4. Large deviations in the Bottcher case. As well-known, in the Bottcher 
case the following limit 

lim(/„(s))^"""^ B(s), < ,s < 1, (28) 

ntoo 

exists, is positive and continuous. From this it follows that in general fn{s) does 
not converge as n | oo. But taking logarithms, we have 

hm Ai-"log/„(s) logB(s). (29) 

ntoc 

On the other hand, our result on lower deviations in the Bottcher case (Proposi- 
tion is also only for log-scaled probabilities. These two facts explain the use of 
a logarithmic scaling in our following theorem. 

Theorem 9 (Bottcher under Ught tails concerning Xi). Assume the Bott- 
cher case, that Ec'''^^' is finite for some h > 0, and that e„ — > as well as 
e^m" —> oo as n 1 oo. Then 

logB(v?(l/2o-2)) < liminf e-2'^m-''"logP(i?„ > e„) (30a) 

n'\oo 

< limsup e,-2'3TO-'^"logP(i?„ > £„) < ^-Mog 8(^(1/20-2)). ^-gQ^^ 

n'foo 

//, additionally, Sn — m^^"/^ for integers An oo with An = o{n) as n ^ oo, then 
lime-2'5m-''"logP(i?„>£„) = log B((p(l/2a2)) . (31) 

nf oo 

According to this theorem, the main contribution to P(-R„ > e„) comes from 
lower deviations of Zn and large deviations of Sn ■ In order to explain this heuris- 
tically, we note that by Proposition 01 there exist (positive and finite) constants 
ci > C2 such that 

exp[-ci (fc/m")^'^/(i-'^)] < m" P(Z„ = fc) < exp[-C2 (fc/m")"^/'!-'')] . (32) 
On the other hand (for details see the proof of Thcorcm|^in Subscction l3.3l below). 

exp[-C3£^fc] < P(5fc>e„fc) < exp[-C4 4fc] (33) 

for some C3 > C4 . Then, roughly speaking, 

00 

P{Rn > £„) - TO"" exp[-a(fc/m")"'^/(i-'') - belk] (34) 

with a, 6 > 0. Obviously, the value of this sum is determined, in a sense, by the 
maximal summand. It can now easily be seen, that the function 

(7(m) a(u/m")-''/(i-^) m > 0, (35) 

achieves its minimum at :— cSn^^^ '^'m"'' [with c we always denote a (positive, 
finite) constant which might change its value from place to place], and, consequently, 

g{u,) = cef m"'^. (36) 
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This is in line with the normahzing sequence in Theorem IHl (except a constant 
factor). 

If we put formally a = c» in the conditions in Theorem [7Jb), then H23|) should 
hold under the condition Sn'm^^'^ oo, since >f — )■ 1/2 as a t oo. But we prove it 
only under a slightly stronger condition on £„ : 

Theorem 10 (Bottcher under heavier tails concerning Xi). Suppose the 
Bottcher case and that Xi has a tail of index 9 > 2. If e„m"/^ri^^/^'^ — > oo, then 
H23|l is true. 

There is the same "philosophy" behind Theorem^|as it is behind Theorem[7Jb). 
The main influence of normal deviations explains also the independence of H23|l of 
the parameters a and f3. Note also that in the special case £„ = e, Theorem |7Jb) 
was proved in |NV03| . 

Remark 11 (Possible generalizations). Many conditions in our results are too 
restrictive, but allow us to make proofs slightly shorter and clearer. Here we mention 
some (almost evident) generalizations of our theorems. 

(a) It is possible to prove versions of TheoremsElandElfor Xi from the domain 
of attraction of a stable law of any index. 

(b) Theorems 171 and [TUl can be generalized to the case P{Xi > x) ~ L{x)x~^ 
with some L, slowly varying at infinity. 

(c) We conjecture that condition EZi log Zi < oo can be dropped in all of our 
theorems. In fact, we need it only for inequality H39(l below, taken from 
Theorem II. 4. 2 of Athreya and Ney |AN72| . But it should be possible to 
prove this bound for all supercritical Galton- Watson processes. 

(d) In |N V04| . P(Z„ > £„ ; Z„ > «„) is considered with w„ — > oo and e„ = e. 
Our methods allow to deal with the case — o{m") and £„ — > 0. O 

Remark 12 (On critical Galton- Watson processes). For the moment, suppose 
that the Galton- Watson process Z is critical, that is, m — I. Furthermore, assume 
that B ■= EZf - 1 e (0, oo). Then, analogously to lO, 




For the proof of this convergence in the two special cases of Xi as mentioned in 
Subsection ll.il see |Nag67| and |Pak75| . respectively. From we find that for 
critical processes the domain of large deviations is defined by the relation £^n oo 
as n t oo. The special case £„ = £ was treated by Athreya and Vidyashankar |AV97| . 
If now £„ ^ and £^n oo, then 

2 

lim£2nP(i?„ >£„|Z„ >0) = ^. (38) 

Actually, H38|l is similar to the statement of Theorem[Slin the case a — 1 and if to" 
replaced by the order n of E{Z„ | Z„ > 0}. Also, the proof of H38() is close to the 
proof of Theoreminiin the case a = 1. There are only two differences. First, instead 
of (|39|l below, we have to use P[Zn — k\Zn > O) < cn~^, which is derived in 
S.V. Nagaev and Wachtel |NW05j . Second, we have to use the local limit theorem 
for critical Galton- Watson processes instead of Proposition 13 For the proof of this 
local limit theorem under a second moment assumption, see |N W05| . O 
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2. Auxiliary results 
In this section we prepare for the proofs of our main results. 

2.1. Separate considerations. As a first step, we state two bounds for local prob- 
abilities of our supercritical Galton- Watson process Z (satisfying EZilogZi < oo). 

Lemma 13 (Local probabilities of Z). We have 

P{Z^^ k\Zo^ i) < cj, k,i,n>l. (39) 

Moreover, in the Schroder case, 

P(Z„ = fc|Zo = l) < k,n>l. (40) 

Proof. For aperiodic (c? = 1) offspring laws the proof of inequality H39|) is given in 
|AN72[ Theorem II. 4. 2]. The proof in the remaining case d > 1 can be carried out 
similarly. 

In proving (|40|l it is sufficient to assume that k < m", otherwise (|40ll follows from 
Under the present condition EZilogZi < oo, formula (151) from (FWOB) 
with N = £(j := 1 + [1/a] and j = n — Uk where Uk ■— min{j > 1 : > k} reads 

as 

oc 

J2P{Z„^a,=i)P{Za,^k\Zo=i) < ;^/n-a.(e-^). (41) 

It follows from l|17|l that the right hand side is bounded by cm""'' 7"^"''. Since 

k < m°'= < mk and 7 = m"", (42) 

we get the bound 

P(Z„_„, ^i)F{Z,^=k\Zo = i) < c-^. (43) 

If £0 — 1, then the proof of H4U|) is complete, since the left hand side in (|43|) equals 
P^Zn = k). Assume now that £0 > 2. From it follows that 

£0-1 p la-l 

J2 P{Zn-a, =i)P{Za,^k\Zo^£) < C f ^(^"--'^ = ' (^4) 

i=i e=i 
By (|18|l . lim„|oo 7 " P(^n = £) = I'e < oo, for every fixed £. Hence, 

YPiZn-a,^£) < cr-"" (45) 

for all n > 1. Using again H42|l . we get 

Y P{Zn-a, = e)P{Za, ^ k \ Zo ^ £) < C ^ . (46) 



= 1 



This completes the proof. □ 

The following lemma contains two versions of the so-called Fuk-Nagaev inequality 
for tail probabilities of sums of i.i.d. variables. Recall that we assumed that Xi is 
centered and has positive finite variance. 
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Lemma 14 (Fuk-Nagaev inequality). For A; > 1, £„ > 0, ?! > 1, r > 1, and 

t > 2, 

FiSk>enk) < fcP(Xi>r-ie„fc) + (em2)'-e-2r^-r^ (47) 

and 

PiSk>Snk) <kP{Xi>r-hnk)+cxp\-——^—^ elk] (48) 
/(t + 2)r*"iE{Xj; < < e„fc}\f/(t+2) 

Proo/. By (1.56) and (1.23) in S.V. Nagaev |Nag79| , for all u,w > 0, 

P(^fe > m) < fcP(^i > «) + e"/"( ) (49) 

and 



V{Su>u) < fcP(Xi >t;)+exp - ^———^ (50) 



{t +^e* a2 
■(t + 2)fcE{Xj; 0< Xi <v}\tu/it+2)v 



\ tuv*- ^ 

Putting here u = e„fc and v = u/r, we get (|47|) and (|48|l . finishing the proof. □ 

Remark 15 (On the case e„ = e). Here we prove a one-sided version of Q con- 
cerning our general i?„ , assuming the Schroder case and that E^X^Y^'^ < 00. 
Take any e > and set g„(fc) := m"" P(Z„ = k) P{Sk > ek). From estimate (gO)) 
we get, for all n,k>l, the inequality 5n(A;) < cg{k), where g{k) :— fc"^^ P{Sk > 
ek). Next we show that g{k) is summable in k. Letting e„ = e and r = a + I in 
(jTTji . we see that for all k> 1, 

g{k) < fc"P(Xi > efc/(l + a)) -f ce-2-2a^-2^ (5^) 

But the summability of fc" P(^i > ck) with some (hence all) positive c is equiva- 
lent to the finiteness of E(Xj^)^+", and we get the claimed summability of g{k). 
On the other hand, it follows from (|18|l that for every fixed k, 

limg^ik) = iykP{Sk>ek). (52) 

njoo 

Therefore, by dominated convergence, 

00 00 
limV5„(fc) = Vi.fcP(^fe>£fc). (53) 

nToo ^ — ^ ^ — ' 

Recalling the definition of gn{k) and using H12|l . we obtain 

00 

lim m"" P(i?„ > e„) = V P(5fe > ek), (54) 

nToo — ^ 

yielding the wanted one-sided version. O 
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2.2. Interplay between the two competing forces. In the next four lemmas 
we prove bounds for different parts of the sum at the right hand side of H12|l . 

Lemma 16 (A tail estimate). Assume Xi has a tail of index 6 > 2. Then 

^ P(Z„ = fc)P(5fc >£„A;) (55) 

k >m"- 

< c(e-^m-(^-i)" + (e2m")-iexp[-c4m"]), £„ > 0, n > 1. 

Proof. Letting t = 9 + 1 and r = {t + 2)/t in H48|l . and using that Xi has a tail of 
index 9 > 2, we get the bound 

P{S,>e^k) < c{e-Ok-^'-'^ + E{-^i^^^^i^€^[0^^»fc]} ) +exp[-c4fc]. (56) 

Clearly, under (|^ . 

E{xf+^; Xi e [0,x]} ^ a9x as x t oo. (57) 

Thus, 

E{xf+^ Xi e [0,a;]} < cx, x>l. (58) 
On the other hand, if a; < 1, 

E{xf+^ e [0,2:]} < x^+'^P{Xi e [0,x]) < X. (59) 

Therefore, 

E{xf+^ Xi e [0,a;]} < cx, x>0. (60) 
Applying this to the expectation in (|56|l . we get 

P{Sk>enk) < ce-«fc-(^-i) +exp[-c4fc]. (61) 

Moreover, combining this bound with l|39|l gives 

J2 F{Zn^k)P{Sk>enk) < ce"^ ^ fc'^ + ^ fc-^ exp[-c4fc]. (62) 

k >m" k >m" k >m"- 

Obviously, 

^ k-' < cm-(^-i)". (63) 

On the other hand, 

A;"-^ exp[-c£^/c] < m""^ ^ exp[-ce^/c] 

< c(£2TO»)-iexp[-ce2m"]. (64) 
Substituting and into ||H21l finishes the proof. □ 

Lemma 17 (Another tail estimate). Suppose the Schroder case, let Xi satisfy 
the moment condition and let e„ —>■ 0. T/ien 

limsupe^"™"" P{Zn^ k)P{Sk>enk) < , A > 1. (65) 



n'\oo 



k>A/el 
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Proof. Combining (|40|l and (|47|l with r = a + 1 gives 
m"" PiZn = k)P{Sk>enk) 

k>A/el 

< c( ^ fc"P(Xi > (a+l)-l£„yfc) + £-2(a+l) ^ fc-2y (gg) 
k>A/el k>A/el 

Note that 

e,T''"+'^( E ^"') ^ 1^"'"' ">0' ^">0' ^^1- (67) 

On the other hand, to bound the first sum at the right hand side in Ht)t)|l . note first 
that 

/ u"P(Xi > (a + l)-i£„M)dM > (fc-l)"P(Xi > (a + l)-ie„fc), A: > 1. 

Jk-l 

This inequahty can be continued by using fc — 1 > fc/2 for k > 2. Summing up 
gives for < 1/2, 

POO 

V fc"P(Xi > (a + l)-ie„/fc) < c / u"P{Xi>{a + l)-hnu)du 

/•OO 

< ce-"-W w"P(Xi>w)du. (68) 

J(A-£2)/(Q+i)e„ 

Recall that we assumed the moment condition (|13f) and that e„ — s- 0. Then the 
integral in H68() converges to zero as n t oo, uniformly in > 1. In particular, 
under a > 1, H68I) is of order o(e~^"), uniformly in A> 1. On the other hand, if 
a < 1 and since EXf < oo, 

v"P{Xi>v)dv (69) 

(A-£2)/(a+i)e„ 

pl — Q /-OO 

as n 1 CX3, uniformly in A> 1. Thus, for each a < oo we have 

sup E fc"P(Xi > (a + l)"^£„fc) = o(£-2") as n too. (70) 



k >A/eI 



In particular, 

limsup^" fc"P(Xi > (a + l)-i£„/c) < ^, A > 1. (71) 

Combining (|65|l . (|57|l . and (|71|l gives the claim in the lemma. □ 
Lemma 18 (Initial part). In the Schroder case, 

Y P(^„ =fc)P(5fc >e„fc) < c,5"£-2a^-«n^ (72) 
1 < A; < S/el 

S > 0, £„ > 0, 71 > 1. 



12 



FLEISCHMANN AND WACHTEL 



Proof. It follows from that 



P(^„ = fc)P(5fc>£„fc) < PiZn = k) 

l<fe<<5/£2 l<k<S/£l 

c 

m' 



< V /c"-i < c<5"e-2"m-"", (73) 

1 < A; < S/el 



finishing the proof. □ 

Lemma 19 (A central part and another initial part estimate). Suppose 
1 < a < cxD and that Xi has a tail of index 9 Cz (2, 1 + a). Then 

Y P(^„ = fc)P(5fc >£„fc) (74) 

A /el <k<Sm" 

< C ((5l+"-«e- + e-2a ^-a„) ^ 

A> 1, S > 0, e„ > 0, 71 > 1, and 

Y P{Zn^k)P{Sk>enk) (75) 

1 < < (5m" 

< c(,5i+"~«e-''m-(''"i)" + £-2«m-""), 5 > 0, e„ > 0, n > 1. 
Proof. Combining (|40|l and (|47() with r = a + 1 gives 

^ P(Z„ = A;)P(5fe >e„fe) (76) 

A/e2 < < 5,„>i 



< cm 



From (jnZIl, 



\A/e2<A:<5m™ A/el <k<Srn'^ / 



^ fc-^ < js-'-. (77) 

A/e^ </c<(5m" 



On the other hand, since Xi has a tail of index 6 £ (2, 1 + a), 

Y k"P{Xi>{a + l)-^enk) < ce-'^ ^ A:""^ 

A/el<k<Sm" l<k<5m" 

< c£-''<5i+"-V(i+"-^)". (78) 

Combine to get (|71jl . 

Putting v4 = 1 in l(7^ and 5 1 in ifT^ . we obtain (|751) . finishing the proof. □ 

Recall that (/i, d) refers to the type of the offspring law, a G (0, oo) to the 
Schroder constant, and that Xi is assumed to have a finite variance. For < 6 < 
1 < A < oo, consider 

E„(5,A) := Y PiZn^k)PiSk>enk). (79) 

S/el <k< A/ el 
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Lemma 20 (Another central part estimate). Suppose the Schroder case, that 
£n —>■ 0, and that e^m" —^ oo. Then for all 0<S<1<A< oo, 



V; / $(x/^/<T)dii < liminf 4"m""S„((5,A) 

Js "Too ^ 

< limsup e^"„^""s„((5,A) < V* j u"-^ ¥(\AI/(t) du 

with and V* defined in (|15(l . and where ^{x) := 1 — $(a;). 
Proof. In view of JHl in Proposition |31 with fc„ = ^l^'in 

E„(5,A) = (l + o(l))d ^ m-"u;(;i^)P(5fe >£„fc) as n T oo 

with A) {fc e [V^n' ^/^n] ■ k = ^. (modd)}. Clearly, 



UQ — 1 



feeff(i5,A) 



fceff(<5,A) 



where we set 



By the central limit theorem, 



sup 

k&H{5,A) 



as n t oo. 



Hence, as n t oo, 



fc"-ip(5fe>£„fc) = (i+o(i)) fc""'i'(v^^) 

feei/(<5,A) keH(5,A) 

/■^ - 



(80) 



E ^P(^fc>£„fc) < ^ m-"w;(;^)P(5fc >£„fc) (82) 



feG-fi"(<5,A) 



inf wi^"w(u), V*{n) sup ^^-"^(u). (83) 



(84) 



(85) 



Substituting (|S5|) into (|S^ and noting that we have K (n) — > T4 and P^* (n) — > V* 
as n 1 oo by our velocity assumption on £„ , we obtain (|80|l . □ 

Finally, we compute the limit, as (5 1 and A f oo, of the integral from (jHUJ). 
Lemma 21 (A moment formula for the Gaussian law). For < a < oo, 

2"-ir(a + l/2) _ ^ 



(86) 



14 



FLEISCHMANN AND WACHTEL 



Proof. Substituting v = \i^/cr, we have 

poo poo 

Jo Jo 



poo poo 1 2q poo pt 

2^2" / d« v^"-' / ^e-* /2 = 2 ^ / dt e-* / d« i;^"-! 

Jo Jv v27r vSvr Jo Jo 

2a poo 

f^'e-^/^dt. (87) 



a 



a\p2/K Jo 

Substituting now v = 1^/2, the chain of equahties can be continued with 



2"-V2" _ 2"-ir(« + l/2) 

' ^/^e ^du = — — a 



la 



a^TT 7o (^^^ 
which equals Fq, from The proof is finished. □ 

3. Proof of the main results 

3.1. Proof of Theorem |5j We wih use decomposition (|12|l . Combining Lem- 
mas ^1 1201 and El and using that 6 and A are arbitrary, we see that 

pOO 



/ '^{Vu/<J) du < hminf e^" m"" V P(Z„ = k) P(5fc > £„fc) (89) 

Jo "Too ^ 

< limsup 4"to""^P(Z„ = fc)P(5fc > £„fc) < V* u°'-^'^{Vn/a)du. 

"Too j^^^ Jo 

With Lemma 1^ the proof is finished. □ 

3.2. Proof of Theorem 13 Let e„ = o{m~^^). Then under the assumptions in 
the theorem, 

e-V-(^-i)" + (£>")-' = o(e-2« TO-""). (90) 
From this relation. Lemma IT^ and (|74|l with 5 = 1, we get 

limsupe^"m"" ^ P(^„ = fc) P(5fc > e„fc) < , A > 1. (91) 

Theorem Ufa) follows from this bound, f7^ . and JHOI)- 

We turn now to the proof of parts (b) and (c). It is known (see for example 
Borovkov jBorOOj V that if P(Xi > x) is regularly varying as a: t oo with index 
9 > 2, then for every sequence ^ oo. 



lim sup 

''Too ^. 2,>aj^(fciogfe)i/2 



PjSk > x) _ ^ 
fcP(Xi > x) 



0. (92) 



Note that if (5 > 0, k> (5m", and £„ > Jto"^", then e„ > (J^+^A;-^. Hence, 

> S^+- ^ . (93) 



(fclogfc)^/^ (logfc)^/^' 
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Since < >c < 1/2, the right hand side goes to infinity as A; | oo, and we will use 
it as ak ■ Thus, applying H92|l gives, as n "f oo, 



F{Zn^k)P{Sk>Snk) = (1 + 0(1)) ^ fcP(Z„-fc)P(Xi>£„fc) 

k~>S 771''^ 

= {l + o{l))ae-' Yl k-^'-'^P{Zr.^k), (94) 



k>5m, 



where in the second step we used that Xi has a tail of index ^ (2, 1 + a). By 
(|^ we have 



l<k<5r, 



l<k<5n 



By Theorem 1 of |NV03| . for - 1 < a, we have E{Z~'*~^^; Z„ > 0} ~ 
/g m^*^^^^-'" as n t oo, with Ig defined in (|24|l . Hence, for all sufficiently large n, 



J2 fc-(^-^'p(z„ = fc)-/< 



e m 



< cm-(«-i)"5i+"-^ (95) 



Combining and (|^ . we have the bound 



lim sup 

nfoo 



£^m(»-i)" Y PiZn = k)P{Sk>enk)-aIe < c5'+''-'. (96) 



If e„m^" 
estimate (TTSll 



k>Sm^ 

oo, then, obviously, e~^"m~"" 



o{e-'' m-'-^-^'^"-). Therefore, by 

(97) 



limsup ef,m(''-i)" ^ P(Z„ = fc) P(S'fc > £„fc) < c <5i+"-^ 

l<fc<5m" 

Part (b) follows from and by letting S 10. 

Finally, under e„ ~ r-^m"^", part (c) follows from ijTlll, (EOJ, (jHS, (El), and 
(I96II . The proof is finished altogether. □ 

3.3. Proof of Theorem|9j It follows from the assumed finiteness of an exponential 
moment of Xi, see e.g. Lemma III. 5 in Petrov jPet75| . that for every S G (0, 1) 
there exists hg > such that 



Ee'^^i < e-'(i+*)''V2^ \h\<hs. 



(98) 



Thus, we may use the well-known Bernstein inequality, see Theorem III. 15 in 
|Pet75| . This gives, for all fc > 1 and e„ < /15 , 

F{Sk>enk) < exp[-(l-5)^"''^ 



2a2 



Therefore, 



P{Rn>en) < /„(cxp -(l-<5)^ 2 



In 



if En < hs . 



(99) 



(100) 



We may also assume that e„ < 1/m. Set r„ :— maxjfc > 1 : rn'^ < e„^}. Then, 



—r —1 2 ^ 

m " < e„ < m 



The left hand inequality together with the monotonicity of /„ gives 

2 

/„(exp[-(l-5)^]) < /„(exp[-(l-<5). 



2a2 



(101) 



(102) 
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Bounds H1Q0|I . H1Q2|I . and the right hand incquahty in l|101l) imply 
e-2'3rn-"^logP(i?„>£„) < ;i-"+-Mog/„(exp[-(l-<5)^ 



(103) 

where we used fi = . Since r„ — > cxd, by the Kesten-Stigum theorem for super- 
critical Galton- Watson processes, 

-1 - 



hm /r„+i ( cxp 

ntoo 



-{1-5) 



2a2 



) = ^((l-<5)/2a2). 



(104) 



On the other hand, from the assumption e^m" — > oo and the right hand inequality 
in H101|l it follows that n — r„ — > oo. Therefore, by (|28|l we have for s € [0, 1], 

limAi-"+""+Mog/„_,„_i(s) = logB(s). (105) 

n\OQ 

By the continuity of B, combining (|104|l and (|105|l we obtain 



lim ^-"+'■"+1 log /„(exp [ - (1 - ^) 



2ct2 



logB(^((l-<5)/2a2)). (106) 



Now (|30b|) follows from ifTU^ and ifTUB)) letting S iO. 

In order to prove (|30a|l we will exploit the following version of Kolmogorov's 
inequality: For < S < 1 fixed, there exists a constant D e (0, oo) such that 



PiSk>enk) > exp[-(l + 5)||| 
See Statulevicius |Sta66| . Using l(TU7l) we obtain 



k>D/el, n>l. 



(107) 



k>D/el 

=■2 



> /« exp 



(1 + -^) 



2a2 



(108) 



Clearly, if D/e^ < /x", then P(Z„ < -D/e^) = 0, and we pass directly to statement 
()112|l below. Otherwise, it follows from Proposition 01 that 



P(Z„ < D/sl) < exp[ - ci?-'^/^!-^ (e>")'^/(i-« 
From p08|) . p09|l . and the left hand inequality in (jlOll) . we have 



P(i?„>e„) > /„(exp[- (1 + 5) 
Analogously to (|106|l . 



2a2 



exp 



c(e>")'5/(i~'5) 



(109) 
(110) 



lim fi 



— n+r„ 



log 



/n(exp 



(l + <5). 



2o-2 



logB(^((l + 5)/2a2)). (Ill) 



By the left hand inequality of p01|) . /x"^''" < m'^ {e'^-^m^)^ . Therefore, from the 
limit statement (|111|) we see that the second term at the right hand side of estimate 
()110|) is negligible compared with the first term there, i.e. 



P{Rn>en) > /„(exp[- (l + (5) 



2(72 



(l + o(l)). 



Thus, using the left hand inequality in (|l()l|l . we get the bound 



logP(i?„>£„) > Ai-"+^"+ilog/„(exp[-(l+(5) 



2a2 



(112) 



0(1). (113) 



LD FOR SUMS ON A GW PROCESS 



17 



Since 6 is arbitrary, combining and completes the proof of H3()a(l . 

In the derivation of H112(l from ()in8|l we learned that the second term at the 
right hand side of H1Q8|I is small compared with the first term there. Thus, from 
(fTn^jl together with ifTHnjl we get 



/n(exp 



(114) 



< /„(exp[-(l-<5)^ 



Hence, if e^j = m^^" then (|31|l follows from these inequalities and (|lll|l replacing 
there r„ by A„ , and finally letting S i 0. Altogether, the proof of Theorem is 
complete. □ 

3.4. Proof of Theorem Uni With B2 from Proposition H and 6* > 2 the tail 
index of Xi , define m"/ log'^^^'/'' m^"^/-^^ Then by Proposition H for aU 

sufficiently large n. 



P(Z„ < fc„) < exp[~(S2/2)(fc„/m")-''/(i-^)] = 
Hence, for these n, 

^ P(Z„ = k) PiSk > enk) < P{Zn < kn) < 



m 



k<kr 



and 



^ fc-(^-i^ P(Z„ = k) < P{Zn < kn) < 



-9n 



k<k„ 

It is easy to verify that 

^nkn 



(fc„ logfc„)i/2 



(c + o(l)) £„to"/2„-1/2/3 g^g^l 



(115) 



(116) 



(117) 



(118) 



By our assumption in the theorem, the right hand side converges to infinity. Then, 
we can use H92II with ak '■— e„(A:/ log fc)^/-^ to obtain 



J2 PiZn - k) PiSk > Enk) = (1 + 0(1)) ^ ^ ^) ^ ^»^) 

/c>fc„ 

= (l + o(l))ae;;'' ^ A:-(''-i)p(Z„ = fc) as n t 00. (119) 



fe>fc 



k>k„ 



Theorem 1 of |N V03| and l(TT7l) yield 

^ A:-(''-i)p(Z„ = fc) = (1 + 0(1)) as 71 too. (120) 

fe>fc„ 



Substituting this into pi9|) and combining with (|116|) completes the proof. □ 
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